Multimodal Stereo Vision Using Mutual Information with Adaptive Windowing
نویسندگان
چکیده
This paper proposes a method for computing disparity maps from a multimodal stereovision system composed of an infrared and a visible camera pair. The method uses mutual information (MI) as the basic similarity measure where a segmentation-based adaptive windowing mechanism is proposed for greatly enhancing the results. On several datasets, we show that (i) our proposal improves the quality of existing MI formulation, and (ii) our method can provide depth comparable to the quality of Kinect depth data.
منابع مشابه
An iterative adaptive multi-modal stereo-vision method using mutual information
We propose a method for computing disparity maps from a multi-modal stereo-vision system composed of an infrared-visible camera pair. The method uses mutual information (MI) as the basic similarity measure where a segmentbased adaptive windowing mechanism is proposed along with a novel MI computation surface. The computed cost confidences are aggregated using s novel adaptive cost aggregation m...
متن کاملMutual information based registration of multimodal stereo videos for person tracking
Research presented in this paper deals with the systematic examination, development, and evaluation of a novel multimodal registration approach that can perform accurately and robustly for relatively close range surveillance applications. An analysis of multimodal image registration gives insight into the limitations of assumptions made in current approaches and motivates the methodology of the...
متن کاملStereo Vision Correspondence Selection using Mutual Information and the Development of a Parametric Framework
This paper addresses the problem of correspondence selection in stereo vision using the mutual information (MI) measure. MI is an information theoretic topic that has recently seen a prolific expansion in the computer vision and medical imaging field. Two main issues are considered in this paper. Firstly, a new stereo matching algorithm is presented that uses a histogram-based formulation of mu...
متن کاملA Maximum Likelihood Stereo Algorithm
A stereo algorithm is presented that optimizes a maximum likelihood cost function. The maximum likelihood cost function assumes that corresponding features in the left and right images are Normally distributed about a common true value and consists of a weighted squared error term if two features are matched or a ( xed) cost if a feature is determined to be occluded. The stereo algorithm nds th...
متن کاملRegistering Multimodal Imagery with Occluding Objects Using Mutual Information: Application to Stereo Tracking of Humans
This chapter introduces and analyzes a method for registering multimodal images with occluding objects in the scene. An analysis of multimodal image registration gives insight into the limitations of assumptions made in current approaches and motivates the methodology of the developed algorithm. Using calibrated stereo imagery, we use maximization of mutual information in sliding correspondence...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2013